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WHAT IS CLAIMED IS : 

1 1 . A method for integrating multimedia descriptions, comprising: 

2 receiving multimedia content; / 

3 separating the multimedia content into multimedia c2uegories; 

4 generating multimedia descriptions from each multimedia category; 

5 integrating the multimedia descriptions from each category using a 

6 multimedia integration description scheme; and / 

7 storing the integrated multimedia descripiion into a database. 

1 2. The method of claim 1 , wherein the multnnedia categories include at least one 

2 of image, audio, video, synthetic, and text. / 

1 3 . The method of claim 1 , wherein the Fnultimedia descriptions include 

2 descriptors, the descriptors defining a portion^f the multimedia content. 

1 4. The method of claim 3, whereip the descriptors include descriptor values, the 

2 descriptor values of descriptors fromfat/tekst-efie multimedia description being combined 

3 with the descriptor values of at least jone other multimedia description using the 

4 multimedia integration description'scheme. 

1 5. The method of claim^l , wherein the multimedia integration description 

2 scheme is compatible with MPEG-7. 

1 6. The method of ^laim 1 , wherein the multimedia integration description 

2 scheme includes at least/one of image, audio, video, synthetic, and text description 

3 schemes. / 

1 7. The method of claim 6, wherein the description schemes and the multimedia 

2 integration description schemes use a compatible description definition language. 

1 8. Th^ method of claim 1 , fiirther comprising: 

2 / receiving a request for the integrated multimedia description from a search 

3 engine sprver; 

4 / retrieving the integrated multimedia description from the database; and 

5 / providing the integrated multimedia description to the search engine server 

6 inresponse to the request. 
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1 9. The method of claim 1 , wherein within the muUimedia integration description 

2 scheme a multimedia stream is represented as a set of relevant multimedia obje^s that 

3 can be further organized by using object hierarchies. 

1 10. The method of claim 9, wherein relationships among multiple multimedia 

2 objects are expressed using at least one of a tree structure and an entity relation graph. 

1 11. The method of claim 1, wherein the integrated muhimeaia description is 

2 represented in a document type definition in extensible Markup4.anguage (XML). 

1 12. The method of claim 1, wherein a client/server ^tem uses the multimedia 

2 integration scheme to perform a search in response to a user's query. 

1 13. A system that integrates multimedia descriptions, comprising: 

2 a plurality of description generatorsyrfiat receive multimedia content, 

3 separate the multimedia content into multimedia/categories, and generating multimedia 

4 descriptions firom each multimedia category; md 

5 a multimedia integration description generator that integrates the 

6 multimedia descriptions generated by th/plurality of description generators from each 

7 category, using a multimedia integrat^n description scheme, and stores the integrated 

8 multimedia description into a/dataj^ase. 

1 14. The system of cldin/l V^^rein the multimedia categories include at least 

2 one of image, audio, video, ^ynihetic, and text. 

1 15. The system of claim 13, wherein the multimedia descriptions include 

2 descriptors, the descriprors defining a portion of the multimedia content. 

1 16. The system of claim 15, further comprising: 

2 an/integration description unit that provides descriptor values fi*om the 

3 descriptors to rt(e multimedia integration description generator, the descriptor values of 

4 descriptors from at least one multimedia description being combined with the descriptor 

5 values of ai least one other multimedia description using the multimedia integration 

6 description scheme. 

1 /l7. The system of claim 13, wherein the multimedia integration description 

2 scheifie is compatible with MPEG-7. 
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1 18. The system of claim 13, wherein the multimedia integration deseJription 

2 scheme is generated by a multimedia description scheme unit and includes at least one of 

3 image, audio, video, synthetic, and text description schemes. 

1 19. The system of claim 18, wherein the description schem€s and the multimedia 

2 integration description schemes use a compatible description d^nition language. 

1 20. The system of claim 13, wherein the multimedia integration description 

2 generator receives a request for the integrated multimedia description from a search 

3 engine server, retrieves the integrated multimedia d^cription from the database, and 

4 provide the integrated multimedia description t^/fhe search engine server in response to 

5 the request. 

1 21. The system of claim 13, wherdn within the multimedia integration 

2 description scheme a multimedia^tre^ is represented as a set of relevant multimedia 

3 objects that can be further organized by using object hierarchies. 

1 22. The system of clair^^^, wherein relationships among multiple multimedia 

2 objects are expressed usingy^ least one of a tree structure and an entity relation graph. 

1 23. The system claim 13, wherein the integrated multimedia description is 

2 represented in a document type definition in extensible Markup Language "(XML). 

1 24. The system of claim 13, wherein a client/server system uses the multimedia 

2 integration scheme to perform a search in response to a user's query. 



